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n.  abstract 


Many  communication  and  control  systems  employ  signal  formats  that  involve 
some  form  of  periodic  processing  operation.  Familiar  examples  are  signals 
produced  by  samplers,  scanners,  multiplexers,  or  modulators.  Very  often 
these  signals  can  be  modelled  as  cyclostationary  processes,  i.e.,  processes 
whose  statistical  properties,  such  as  mean  and  autocorrelation,  fluctuate 
periodically  with  time.  Filters  designed  tc  extract  signia3  of  this  type 
from  a  noise  background  can  exhibit  dramatically  improved  performance 
when: the  periodic  nature  of  the  statistics  are  teken  into  account,  rather 
than  using  the  more  conventional  "time -average”  statistical  approach. 

Some  techniques  for  solving  for  the  optimum  filter  and  a  video  signal 
example  are  discussed. 
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I.  Introduction; 

A  random  signal  process  which  is  produced  by  a  periodic  sampling, 
scanning  or  synchronous  multiplexing  operation  can  often  be  modelled 
by  a  process  which  exhibits  periodicity  in  its  mean  and  autocorrelation 
functions.  A  process,  x(t),  is  said  to  be  cyclostationary  in  the  wide 
sense  (with  period  T)  if 

E[x(t) ]  -  E[x(t  ♦  T)]  (1) 

kxx(s’  *  E[x(s)x*(t)]  «  kxx(s  ♦  T,  t  ♦  T)  (2) 

for  all  s  and  t.  Bennett  [1]  introduced  the  term,  "cyclostationary", 
to  denote  this  class  of  processes  in  his  treatment  of  synchronously 
timed  pulse  sequences  used  in  digital  data  transmission.  Other  investi 
gators  [2] -[5]  have  used  terms  such  as  "periodical lj  stationary",  "pen 
odically  correlated",  and  "periodic  nonstationary"  to  denote  this  same 
class. 

One  important  example  of  a  cyclostationary  process  xs  the  synchro¬ 
nous  pulse  amplitude  modulation  (PAM)  signal.  Assuming  that  the  pulse 
amplitudes  {a^}  form  a  stationary  sequence  of  random  variables,  we  have 

«D 

x(t)  *  l  aks(t  -  kT) 
k*-*° 

where  Eja^]  «  a 

EIV„V  *  °m 


for  all  k 


By  inspection,  the  expressions  in  (4)  are  periodic  T  in  t  and  hence  the 
PAM  signal  is  a  cyclostationary  process.  Typically,  the  pulse  amplitudes 
could  be  the  result  of  uniformly  sampling  a  wide- sense  stationary  process. 

For  example,  the  output  of  a  conventional  sample-and-hold  device  can  be 
represented  by  (3)  where  s(t)  is  a  unit  amplitude  rectangular  pulse  of 
width  T.  Other  forms  of  pulse  modulation  such  as  frequency-shift  keying 
(FSK)  and  phase-shift  keying  (PSK)  will  also  yield  cyclostationary  processes  [7]. 
The  conventional  formats  for  time-division  and  frequency-division  multi¬ 
plexing  of  signals,  and  video  signals  generated  by  rectangular  scanning 
of  a  two-dimensional  field  [9]  provide  additional  examples  of  cyclostationary 
processes . 

In  the  communication  system  examples  cited  above,  it  is  clear  that 
the  receiver  used  for  demultiplexing  or  reconstruction  of  the  signal  into 
its  original  format  will  require  accurate  timing  information  for  satisfactory 
operation.  This  information  is  normal1 y  supplied  by  inserting  synchronizing 
or  framing  pulses  or  by  superimposing  some  other  form  of  periodic  signal 
on  the  random  signal  process.  Another  function  of  the  receiver  is  to 
remove,  to  the  extent  possible,  the  effects  of  noise  interference.  It  is 


of  interest  to  determine  the  amount  of  improvement  in  filtering  that 
results  from  the  cyclostationary  character  of  the  received  signal  process 
and  employing  filters  with  time-variable  elements  whose  periodic  fluctua¬ 
tions  are  "locked  in"  to  the  fundamental  period  of  the  cyclostationary 
process.  We  have  obtained  solutions  for  optimum  periodical ly-varying 
filters  and  expressions  for  improvement  in  performance  over  that  obtainable 
by  the  best  time -invariant  filters.  The  receiver  structures  implied  by 
these  solutions  have  a  form  dictated  by  the  choice  of  representation  used 
for  the  cyclostationary  process.  Two  representation  techniques  which  have 
been  found  generally  useful  are  briefly  presented  in  the  following  section. 

II.  Representation  and  Properties  of  Cyclostationary  Processes; 

We  say  that  a  process  has  a  harmonic  representation  when  expressed 
in  the  form 

\  <© 

x(t)  *  I  an(t)  exP  [j2^]  (5) 

n«-« 

where  choosing 


vi>  -  I 

v (t  -  t)  exp  [-j—^-l  x(t)  dx 

-00 

■  k 

ITt 

sin  -y 

(6) 

makes  the  mean-squared  value  of  the  difference  of  both  sides  of  (5)  vanish. 
Generation  of  the  sequence  of  bandlimited  random  processes,  (an(t)},  is 
illustrated  in  Fig.  1.  If  x(t)  is  cyclostationary,  then  we  can  show  that 
(an(t)}  is  jointly  wide-sense  stationary*  and  we  define: 

*Ogura  [5]  has  presented  a  discussion  of  harmonic  representation;  however, 
he  observes  only  that  the  individual  terms  in  (5)  are  wide  sense  stationary. 
They  are  not  jointly  wide  sense  stationary,  as  the  coefficient  processes 
are,  and  this  point  has  important  consequences  in  the  estimation  or 
filtering  problem. 
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rnm(s  -  t)  -  E[*n(*)*,*(t)l  (7) 

with  the  result  that 

kxx(s'  "  H  rnM(*  -  O  «*P  U  T  (ns  ’  Bt)1  (8) 

n  m 

There  ere  certain  properties  of  the  infinite-dimensional  matrix, 
r(*),  or  its  Fourier  transform  R(«)  which  will  be  useful  in  the  estimation 
problem. 

1)  R(f)  is  bandlimited  to  the  frequency  interval,  |f|  <_  ^jr  .  This 

is  because  the  {a  ft ) >  are  similarly  bandlimited. 
n 

2)  x(t)  is  a  wide-sense  stationary  process  if,  and  only  if,  r(*) 
is  a  diagonal  matrix.  This  can  be  seen  by  direct  substitution 
into  (8). 

3)  Let  x(t)  be  the  result  of  a  time-invariant  filtering  operation  on 
a  cyclostationary  x' (t),  with  representation  R' (•)#  given  by 

m 

x(t)  -  |  h(t  -  t)  x'(T)dr 
then  we  have 

Rnm(f)  *  v(f)  H(f  4  H#(f  4  RnmCf)  (9) 

where  V(f)  is  a  rectangular  function  of  width,  1/T,  which  is  the 
Fourier  transform  of  v(t)  in  (6).  Using  this  result  with  H(-)  corre¬ 
sponding  to  an  ideal  lowpass  filter  with  cutoff  at  W,  we  see  that  a 
bandlimited  process,  x(t),  can  be  represented  by  a  finite  matrix  of 
order  M  where  M  <  2  Tit. 


4)  Let  x(t)  be  derived  from  a  cyclostationary  x*(t)  where  an  uncertainty 


-  S  - 


in  the  tine  origin  or  "phase"  of  the  process  has  been  introduced, 
i.e.,  let  x(t)  ■  x'(t  ♦  6)  where  6  is  a  randon  variable  with  proba¬ 
bility  density  function,  P6(0*  The  Modification  in  the  representa¬ 
tion  is  expressed  by 

(10> 

where  Pj(0  is  the  Fourier  transfora  of  Pa(*)  so  we  know  that 
p6(f)  i  Pa(°)  -  1  (ID 

In  particular,  if  6  is  uniforaly  distributed  over  the  interval  [0,  T], 
then  P(!p)  *  0  for  n  j<  0  and  R(f)  is  diagonal.  Thus  if  a  cyclostationary 
process  is  completely  "phase  randomized"  it  becomes  a  stationary  pro¬ 
cess.  Its  autocorrelation  function  would  be 

k,*<T>  •  I  r™(,)  0  2’  t! 

n 

T 

■  f  |  kx,x,  ft  ♦  t,  t)dt  (12) 

0 

which  is  simply  a  time-averaged  version  of  the  noustationary  correlation. 

An  alternative  fora  of  representation  which  affords  a  simpler  solution 
to  the  filtering  problem  in  many  cases  of  practical  interest  is  the  time- 
series  representation.  This  representation  has  the  form 

M  • 

X(t)  -  l  l  a .  ♦. (t  -  nT)  (13) 

i-1  n--  ni  1 

where  the  (♦|(t)>  are  "doubly-orthogonal"  in  the  sense  that 

m 

\  ♦jtt  -  "T),;  (t  -  .T)dt  . 


(14) 


. —  »^mwMwi»BWiu  ■■!*iTr*rfiS!n»nw- 


=s  4'jyfi  u:  >*.* W^zr?y .  * T.V*fc  rt^Tv^WT 
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and  the  process  is  represented  by  the  random  variables 
00 

«ni  -  |  x(t)  **  (t  -  nT)dt  (15) 

.00 

This  leads  to  a  representation  for  the  autocorrelation  given  by 


where 


K  x(s.  t)  =  HU  ^(s  -  nT)  **  (t  -  mT) 
n  m  i  j  J 


A*^  *  Efa  .a*.l 

n-ra  1  ni  mjJ 


(16) 


f 


■  ■  ■*■  nT  ■  iuT»  T)  $?(*)  4>-(T)dtdT 

j  t  XX  X  J 


(17) 


The  time-series  representation  is  particularly  appropriate  for  the 
various  forms  of  digita"  pulse  modulation.  For  example,  in  the  simplest 
case,  PAM  with  (s(t  -  nT)}  forming  an  orthonormal  sequence,  we  have  M  =  1 
and 


^(t)  8  s (t ) 

a  .  =  a  (18) 

ni  n  v  1 

and  the  K  matrices  in  (17)  are  simply  the  scalar  correlation  values  of 
the  poise  amplitudes  as  given  in  (3). 

A  more  general  application  of  the  time-series  representation  for  an 
arbitrary  eye lost at ionary  process  results  from  a  Karhunen-Loeve  expansion 
of  the  process  over  each  T  second  interval  [6],  using  tho  same  basis 
functions  for  each  interval.  This  has  proved  particularly  effective  for 
the  random  video  process  described  later. 


III.  Continuous  Waveform  Estimation: 


One  of  the  estimation  problems  of  interest  is  the  problem  of 
filtering  to  reproduce  a  faithful  replica  of  the  signal  waveform,  at 
each  point  in  time,  in  the  situation  where  the  received  waveform  has 
an  additive  noise  component.  In  the  following,  we  consider  the  case 
where  there  is  no  channel  dispersion  and  the  noise  is  white,  although 
more  general  results  with  these  restrictions  removed,  follow  directly. 

Accordingly,  the  estimation  problem  we  consider  here  is  evaluation 
of  the  performance  of  the  noncausal,  periodical ly-variable  filter 
which  gives  least  mean-squared  error  reconstruction  of  a  cyclostationary 
signal  process  with  additive  white  noise  having  spectral  density,  Nq. 

The  impulse  response  function,  h(»,  •),  for  the  filter  which  minimizes 

00 

I(t)  «  E[(x(t)  -  J  h(t,  s)z(s)ds}2]  (19) 

-00 

where  z (t )  is  signal  plus  white  noise,  must  satisfy  the  orthogonality 

condition  [6] 

00 

I  k  v(s,  o)h(t,  o)do  ♦  N  h (t ,  s)  »  k  (s,  t)  for  all  s  and  t 

I  aA  O  Aa 

(20) 

Substitution  of  (20)  into  (19)  and  rearranging  terms  yields  a  compact 
expression  for  the  minimum  mean-squared  error. 


1  ■  N  h(t,  t) 


(21) 


8  - 


The  mean-squared  error  in  (21)  is  periodic  T  in  t.  As  a  performance 
functional,  we  select  the  value  of  Ia^n(t)  averaged  over  one  period,  i.e., 


N  T 

Y  j  Mt. 


Using  the  harmonic  representation  scheme  of  (S),  the  optimum  filter 
can  be  interpreted  as  an  estimator  of  the  jointly  wide-sense  stationary 
sequence,  (an(t)}.  This  is  accomplished  by  forming  the  corresponding 
sequence  of  processes  for  the  received  signal  by  means  of  the  structure 
shown  in  Fig.  1.  The  estimate  of  the  n^  process  is  a  linear  combination 
of  time-invariant  operations  on  the  received  signal  processes  which  is 
then  multiplied  by  exp  [j  2*  y-]  to  form  one  component  of  the  filter  output. 
The  structure  of  this  estimator  is  shown  in  Fig.  2  and  the  overall  filter 
is  obtained  as  a  cascade  of  the  structures  in  Figs.  1  and  2.  The  filter 
is  realized  as  a  bank  of  input  and  output  modulators  interconnected  by  a 
matrix  of  time- invariant,  bandlindted  ~r  ,  filter  paths.  We  can  then 
write  the  impulse  response  as 


h(t,  s)  -  H  8„k(t  -  s)  exp  [j  (nt  -  ks)]  (23) 

n  k 


Now  using  (23)  and  (8)  in  (20)  and  performing  the  integration,  the  coeffi¬ 
cients  of  the  exponentials  in  t  and  s  are  equated  and  the  orthogonality 
condition  is  satisfied  by  a  |(»)  matrix  whose  Fourier  transform  is  the 
solution  of 


£(*)  [£*(*)  ♦  -  Ra(f);  If |  <  A. 


(24) 


where  R*(»)  denotes  the  conjugate  transpose  of  R(*). 


Using  (23)  in  (22),  the  expression  for  optimum  performance  becomes 

•• 

Jo  *  No  l  *nn(0)  "  No  f  tr  £<f>df  (2S) 

n  _• 

To  evaluate  the  performance  of  the  best  time-invariant  filter  for 
a  cyclostationary  signal  relative  to  that  of  the  best  periodical ly- 
variable  filter,  we  use  h(t  -  s)  in  (19)  and  find  the  condition  which 
minimizes  the  time-averaged  value  of  I(t).  The  constraint  of  time- 
invariance  is  equivalently  imposed  by  requiring  that  tne  &(»)  matrix 
for  (23)  be  diagonal.  The  new  orthogonality  condition  has  the  simple 
solution, 

R  (f) 

Gnn(f)  *  Rm(f)  ♦  N0  -  (26) 


and  since  £(•)  is  diagonal,  the  filter  transfer  function  is 


H(f)  -  l  Gnn(f>  |)  (27) 

n 

Taking  into  account  the  bandlimited  nature  of  Rnn(f)  in  (26),  the  sum 
in  (27)  can  also  be  written  as 


H(f) 


l  I’ 

n 


m . 


I  R  (f-  ~)  ♦  N  KT?)*N 
“  nnv  T'  o 


(28) 


The  expression  (28)  is  the  familiar  solution  for  the  noncausal  Wiener 
filter  for  a  stationary  signal  with  power  spectral  density  K(f)  in  white 
noise  [6).  Now  referring  to  (12),  we  see  that  K(f)  is  actually  the  power 
spectral  density  for  the  (stationary)  phase-randomized  version  of  the 
cyclostationary  process.  Thus  we  make  the  interesting  observation  that 


the  best  tine-invariant  filter  for  the  cyclostationary  process  is  identical 
to  the  best  filter  for  the  phase-randomized  version  of  the  process.  Further¬ 
more,  this  filter  is  the  result  of  simply  disregarding  the  crosscorrelation 
among  the  (an(t)>  processes  in  making  the  estimation.  The  performance 
functional  for  the  time-invariant  filter  is 


J.  -  N  h  (0) 


■w*-  " 


Bnn<f-  T> 


♦  N 


(29) 


When  the  time-series  representation  approach  (IS)  is  used,  the  optimum 
filter  exhibits  a  similar  representation. 

h(t,  s)  -  HU  H^k  ♦  (s  -  IT)  4*(t  -  kT)  (30) 

£kpq  s  p 

Substituting  (30)  and  (16)  into  the  orthogonality  condition  (20)  and 
performing  the  indicated  integration  by  making  use  of  (14) ,  we  obtain  an 
equation  whose  terms  have  the  same  form  as  (16)  ind  (30).  Equating  coeffi¬ 
cients  in  this  equation,  the  orthogonality  condition  is  satisfied  by  the 
solution  of 

l  0*  *  N0  H„  »  Afl;  for  all  n  (31) 

where  the  matrices  A^  and  in  (31)  have  elem.;-:s  as  indicated  by  the 
superscripts  in  (16)  and  (30). 

The  first  term  in  (31)  is  a  discrete  convolution,  so  z-transform 
techniques  can  be  used  to  express  the  solution.  To  this  end  we  define 

*(*)  ■  l  **  ®xp(J2tnTfl 
n 

£(*)  "  I  »L  exp(j2«nTf)  (32) 

n 
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and  (31)  is  expressed  as 


B(f)L(f)  ♦  ly^f)  *  B(f) 


The  optimum  filter  is  given  by 


H  3  T  ] 
-n  j 


L(f)  exp[-j2irnTfldf 


-1/2T 


where  L(f)  3  (B(f)  +  N 

The  solution  for  the  optimum  filter  (30)  indicates  the  structure  of 
filter  as  outlined  in  Figure  3.  The  structure  involves  a  bank  of  time- 
invariant  filters  whose  outputs  are  sampled  every  T  seconds.  The  appro¬ 
priate  linear  combinations  of  these  samples  are  formed  by  the  time- 

invariant,  multiport,  sampled-data  filter,  characterized  by  the  H  matrices, 

— n 

and  the  output  signal  is  reconstructed  by  impulsing  a  similar  bank  of 
output  filters.  The  performance  functional  for  this  filter  is  given  by 


N  ,1/2T  . . 

Ttr«o'No  l  l  1 


(f)df 


-1/2T 


Solutions  for  specific  examples  related  to  time-division  and 
frequency-division  multiplexing  of  an  arbitrary  number  of  independent, 
band-limited  signal  processes  have  been  presented  [8].  In  the  following 
section,  we  illustrate  the  application  of  the  time-series  method  of 
representation  for  finding  the  optimum  filter  for  the  random  video 
process. 
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IV.  Video  Signal  Process: 


We  assume  that  the  video  signal  results  from  scanning  a  two- 
dimensional  visual  pattern  using  the  conventional  rectangular  raster 
(without  interlace).  The  visual  pattern  is  modeled  with  a  two- 
dimensional  random  step  function  giving  a  stationary  autocorrelation 
with  exponential  form  which  is  separable  in  the  horizontal  and  vertical 
directions  [9] .  Neglecting  frame-to-frame  correlation,  the  scanner 
output  is  a  cyclostationary  process  with  period  T  equal  to  the  line 
scan  interval.  Consider  any  two  time  instants  tj  and  t 2  where  t2 
occurs  in  the  rath  line  after  the  one  which  contains  t,.  Then  the 
normalized  autocorrelation  of  the  scanner  output  is  given  by 

kxx(tl’  t2)  =  pm  exPl-2lrf0lti  "  %2  +  mTU  (36) 

where  the  parameter  f  characterizes  correlation  in  the  horizontal 
direction  and  p  is  the  linc-to-line  correlation. 

For  the  time-series  representation  (13),  we  choose  the  (t )  as  the 
normalized  solutions  of 


i 

|  exp[-2*fo|t  -  s|]*i(s)ds  =  A.^ft) 


for  0  <  t  <  T 


and  we  are,  in  effect,  making  a  separate  Karhunen-Loeve  expansion  over 
each  line-scan  interval.  The  eigenfunctions  in  (37)  are  cosine  and  sine 
functions  [6]  whose  frequencies,  respectively,  are  given  by  the  solutions 


and  tan  irTf^  *  -fj/fo 


tan  irTf^  «  fQ/f^ 


(38) 


,  -sv.s  '~  - t~  ,» 
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The  eigenvalues  are 


h  *  *r  u  *  (W2!'1 

o 


(39) 


and  the  matrix  sequence  characterizing  the  autocorrelation  (16),  (17) 
has  an  especially  convenient  form.  i 


A  a  p lml A 
-m  — 


,  (40) 


where  A  is  a  diagonal  matrix  whose  elements  are  the.  B_(f)  in  (32) 

5 

is  obtained  by  summing  the  double-sided  geometric  series  and  we  get 


3(f) 


r-  p4 


(1  -  p)2  ♦  4p  sin2  nTf 


(41). 


i 1 


Solving  the  orthogonality  condition  (33)  for1  the  filtering: problem  and 
evaluating  the  performance  functional  (35)  gives  the  result. 

N_  i  r,  .  r,  i  ^  1 41/2 


Jo  ■  T  l  h  |{xi  *  No  (Ht)>  <xi  *  Nc  (rff)) 


(42) 


The  performance  (42)  has  been  numerically  evaluated  for  the  'specific  case 

j 

of  a  500-line,  square  format  assuming  that  the  visual  pattern  has  the 
same  correlation  in  horizontal  and  vertical  directions.  This  requires 
p  *  exp[-2irfoT/500) .  Assuming  approximately  equal  resolution  requirements 
in  horizontal  and  vertical  directions,  the  essential  bandwidth  of  the 
signal  is  500/2T  so  we  take  6  *  T/500NQ  as  a  measure  of  the  signal -to- 
noise  power  ratio.  Results  for  various  values  of  p  and  6  are  shown  in  , 
Figure  4. 
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•)  *  |  v(t  -  t)exp[-j2w  ~]z(T)dT  «  ak(t)  ♦  nfc(t) 


Fig.  2.  Estimation  using  harmonic  representation 
of  received  signal. 
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